Scalable Spatiotemporal Graph Neural Networks
نویسندگان
چکیده
Neural forecasting of spatiotemporal time series drives both research and industrial innovation in several relevant application domains. Graph neural networks (GNNs) are often the core component architecture. However, most GNNs, computational complexity scales up to a quadratic factor with length sequence times number links graph, hence hindering these models large graphs long temporal sequences. While methods improve scalability have been proposed context static graphs, few efforts devoted case. To fill this gap, we propose scalable architecture that exploits an efficient encoding spatial dynamics. In particular, use randomized recurrent network embed history input into high-dimensional state representations encompassing multi-scale Such then propagated along dimension using different powers graph adjacency matrix generate node embeddings characterized by rich pool features. The resulting can be efficiently pre-computed unsupervised manner, before being fed feed-forward decoder learns map predictions. training procedure parallelized node-wise sampling without breaking any dependency, thus enabling networks. Empirical results on datasets show our approach achieves competitive art, while dramatically reducing burden.
منابع مشابه
Scalable Representations of Neural Networks
This bachelor’s thesis looks at methods for indirect encoding of neural network weights in evolutionary algorithms with focus on network scalability. HyperGP algorithm was implemented to generate neural networks used to control a robot navigating a simulated environment in order to compare multiple approaches to the evolution. The first approach gradually increases the array of sensors and/or n...
متن کاملNonlinear System Identification Using Spatiotemporal Neural Networks
The so-called spatiotemporal neural network is considered. This is a neural network where the conventional weight multiplication operation is replaced by a linear filtering operation [l]. A training algorithm is derived for such networks. The problem of nonlinear system identification is considered as an application for spatiotemporal networks. Nonlinear system identification is one of the chal...
متن کاملKernel Graph Convolutional Neural Networks
Graph kernels have been successfully applied to many graph classification problems. Typically, a kernel is first designed, and then an SVM classifier is trained based on the features defined implicitly by this kernel. This two-stage approach decouples data representation from learning, which is suboptimal. On the other hand, Convolutional Neural Networks (CNNs) have the capability to learn thei...
متن کاملGated Graph Sequence Neural Networks
Graph-structured data appears frequently in domains including chemistry, natural language semantics, social networks, and knowledge bases. In this work, we study feature learning techniques for graph-structured inputs. Our starting point is previous work on Graph Neural Networks (Scarselli et al., 2009), which we modify to use gated recurrent units and modern optimization techniques and then ex...
متن کاملAdaptive Graph Convolutional Neural Networks
Graph Convolutional Neural Networks (Graph CNNs) are generalizations of classical CNNs to handle graph data such as molecular data, point could and social networks. Current filters in graph CNNs are built for fixed and shared graph structure. However, for most real data, the graph structures varies in both size and connectivity. The paper proposes a generalized and flexible graph CNN taking dat...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Proceedings of the ... AAAI Conference on Artificial Intelligence
سال: 2023
ISSN: ['2159-5399', '2374-3468']
DOI: https://doi.org/10.1609/aaai.v37i6.25880